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SUMMARY 

The introduction of the Global Positioning System (GPS) into the National Airspace System 
(NAS) necessitates the development of Receiver Autonomous Integrity Monitoring (RAIM) 
techniques as identified by RTCA Special Committee 159. In addition, it is anticipated that 
future multisensor positioning systems will also utilize RAIM schemes to guarantee a high level 
of integrity, as evidenced by current FAA programs involving hybrid positioning systems such 
as GPS/LORAN-C. 

In order to guarantee a certain level of integrity, a thorough understanding of modern 
estimation techniques applied to navigational problems is required. In this paper, the extended 
Kalman filter (EKF) is derived and analyzed under poor geometry conditions. It was found 
that the performance of the EKF is difficult to predict, since the EKF is designed for a 
Gaussian environment. A novel approach is implemented which incorporates ridge regression 
to explain the behavior of an EKF in the presence of dynamics under poor geometry 
conditions. 

The basic principles of ridge regression theory are presented, followed by the derivation of a 
linearized recursive ridge estimator. Computer simulations are performed to confirm the 
underlying theory and to provide a comparative analysis of the EKF and the recursive ridge 
estimator. 


BACKGROUND OF RIDGE REGRESSION 

Ridge regression signal processing is introduced in order to counter the effects of poor 
geometry on position estimation. Robert Kelly first applied ridge regression to navigational 
problems in 1988 (ref. 1). Many other papers have followed since then explaining the further 
developments of ridge regression (refs. 1-6). The basic idea behind ridge regression is 
presented below. 

For navigation, the appropriate error criterion is the mean square error (MSE). It 
expresses the deviation of the vehicle with respect to its intended path. The MSE consists of 
the sum of two error components; MSE = Variance + Bias 2 . For ordinary least squares 
(OLS) estimation, the position solution is unbiased; therefore, the MSE is only made up of the 
variance term. (Note that the Kalman filter is a recursive form of the OLS estimator.) Under 
poor geometry conditions, the variance of the position errors inflates significantly, giving an 
inaccurate position estimate. The ridge estimator takes advantage of an extra degree of 
freedom in the MSE which is not used by the OLS estimator - the bias term. In effect, small 
biases induced by the ridge estimator decrease the variance term such that the overall MSE is 
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smaller than the MSE obtained from an unbiased estimator, as illustrated in figure 1. 

The linear model for a system with an unknown n x 1 measurement bias vector, SB, and a 
measurement noise vector, e, is given by 

Y = HB + SB + e (1) 

where Y is the n x 1 range measurement vector, 6 is the p x 1 unknown system state vector 
(or parameter vector), and H is the n x p predictor (or design) matrix which relates the range 
measurement vector to the system state vector. Also, the measurement noise is uncorrelated; 
cov(e + SB) = [ee T ] = cr 2 I, where I is the n x n identity matrix. 

The OLS estimate of equation 1 is 

fio ls = (H'H)-’ H'Y (2) 

The corresponding ridge estimate of equation 1 is 

6, = (H’H + P„)-' H’Y (3) 

where P R is the ridge parameter matrix (which is formed from the chosen ridge biasing 
parameters, k,). When P R consists of zeros, the ridge estimator reduces to the OLS estimator. 
Adding a non-zero ridge parameter matrix to H T H purposely upsets the balance between the 
first and second moment components of ft, thereby introducing a bias. 

For a complete discussion on the comparative analysis of the ridge and OLS estimators, see 
reference 6. 


THE EXTENDED KALMAN FILTER (EKF) 

From reference 6, figure 2 summarizes how the normal Kalman equations relate to each 
other to form the Kalman filter. Since the equations that relate the measurements to the state 
vector are usually nonlinear (i.e. the H matrix is nonlinear), an extended Kalman filter (EKF) 
is needed. Therefore, a linearization procedure is performed when deriving the Kalman filter 
equations, see reference 7. 

After the linearization procedure, the recursive update equation for the extended Kalman filter 
is given by 


k = kn - 1 + (Pwk-i + HjR-’H^H’R-'SX,) (4) 

where 5Y k is the difference between the actual measurements and the predicted measurements 
(the innovations) as shown below 

SY k = Y k - g^B^) (5) 

where g k is a nonlinear vector-valued function which relates the system state to the 
measurements. 
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An optimum unbiased estimator arises when both the model and the estimator match the 
process which generates the data. Kalman filter optimization techniques include the selection 
of the initial error covariance matrix, P 0 , and the system covariance matrix, Q, based upon past 
experience or by adaptively tuning the filter until its innovations (residuals) become white (i.e. 
zero mean and random). However, the selection of the proper Q matrix is usually not a very 
easy task (ref. 8). 

For example, the system covariance matrix Q is often set artificially high such that the 
Kalman filter can track the vehicle when it encounters dynamics such as turning-induced 
accelerations. Therefore, the Kalman filter allows more noise in the solution during periods of 
low dynamics. Although some methods exist for selecting Q adaptively (ref. 9), these are 
stochastic in nature. 

Another problem arises when the Kalman filter is subjected to a poor geometry condition. 

In the case of inaccurate P 0 and Q matrices (a mismatched filter), the filter may become 
biased. The performance of a biased Kalman filter is not readily understood, as the Kalman 
filter is optimal and defined in a Gaussian environment only. Therefore, the performance of a 
Kalman filter for a deterministic maneuver in a poor geometry condition cannot be predicted 
from the regular Kalman filter equations. Furthermore, poor geometry effects cannot be 
minimized by observing the innovations in the Kalman filter’s update equation (see equation 
4), because these effects only appear in the estimator J3. 

In applying the Kalman filter to navigation, the MSE is the appropriate error criterion to be 
minimized. The MSE of a mismatched Kalman filter is not necessarily the smallest obtainable. 
Recall that the MSE is the sum of two components: the variance term and bias term squared. 
Since the Kalman filter is developed from the OLS estimator, it is inherently an unbiased 
estimator. On the other hand, a biased estimator, such as the ridge recursive filter presented 
in the next section, is purposely not matched to the process that generates the data in order 
to achieve a smaller MSE. 


THE RIDGE/EKF FILTER 

Extending the work presented in reference 5, the linearized state update equation for the 
extended Ridge/EKF is obtained as 

= Wi + (C-i + P,„ + H;R-’H k )-’(H;R-'«Y k ) (6) 

where P R|c has been added to the (Pj^.j + term in order to reduce the effects of 

poor geometry. Also, the update equation for the error covariance matrix is given by 

P„ = (P«-, + P„ + (7) 

Two cases may now be defined in which ridge regression can explain the behavior of the 
Kalman filter. First, in the absence of system dynamics, the ridge parameter matrix, P Rk is 
functionally equivalent to the inverse of the state error covariance matrix, P k J k . r Therefore, 
the EKF has similar convergence properties when the model incorrectly represents the system 
and P k/k . 1 is small. (See reference 6 for a discussion on the convergence properties of 
estimators.) Second, if dynamics exist, P Rk is related to both PJ^., and the system error 
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covariance matrix, Q, given by the following relation 

(^P k 4> T + Q)' 1 ~ (4>P k 4> T + Q)* 1 + P Rk (8) 

where, in this case, the symbol means "relating to". Again, the EKF has similar convergence 
properties when the model incorrectly represents the system and (<FP k <l> T + Q)' 1 is small. 

Usually P k is small, which means that the P^., term in equation 6 is large; therefore, there 
is no geometry problem. Note that P k varies as the Kalman filter is updated, but normally a 
constant Q is added which "limits" it (i.e. puts uncertainty in the model). As seen in the above 
equation, P k will be large when Q is large. Q is chosen large for dynamic situations (i.e. turn- 
induced accelerations). When a poor geometry condition exists in addition to the dynamic 
situation, P Rk may be added to counteract the large Q. Therefore, a proper P Rk can be chosen 
to incorporate ridge regression into the Kalman filter. 

The key idea in developing the ridge recursive filter is the following: Each step in the 
recursive process is viewed as a new prior linear model wherein the last estimate B Rk/k _ 1 is the 
prior equation for the next iteration. The ridge solution is recomputed at each step using 
selection rules, described in reference 6, to determine a proper P Rk . 


SIMULATION RESULTS 

This section provides a simulation to evaluate the behavior of an extended Kalman filter 
(EKF) when dynamics exist and a poor geometry condition occurs. Initial results show how 
ridge regression can explain the behavior of a mismatched Kalman filter. 

The EKF is implemented in the following simulation scenario: An aircraft is moving along 
a constant velocity flight path making range measurements to two Distance Measuring 
Equipment (DME) stations. At first (t = 0 seconds), the station locations constitute a good 
geometry situation with respect to the aircraft position. At t = 50 seconds, the aircraft "enters 
a poor geometry condition". This happens when the aircraft switches from making range 
measurements to DME stations 1 and 2 to making range measurements to DME stations 1 
and 3. After some time in this poor geometry condition, the aircraft turns 30° to the right 
(t = 150 seconds) and continues in this situation until the end of the simulation run (t = 300 
seconds). The numbers for the scenario set-up are given below: 

DME station 1 location, [X 1 YJ = [10.0e05 0] feet 

DME station 2 location, [X 2 Y 2 ] = [85.0e05 75.0e05] feet 

DME station 3 location, [X 3 Y 3 ] = [160.0e05 0] feet 

initial aircraft location, [X TR Y TR ] = [85.0e05 -1.0e05] feet 

initial aircraft velocity, [V y V y ] = [100 0] feet/sec 

aircraft velocity after turn, [V x V y ] = [86.6 50] feet/sec 

measurement noise, a - 30 feet 

measurement bias, 5B = [0 0] feet 

aircraft initial position offset, [5X 5Y] = [100 100] feet 
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The aircraft makes 16 measurements to each DME station per second and updates its 
position estimate once every 16 th of a second (i.e. recursive estimation). 

The initialization of the tuned Kalman filter is as follows: The initial estimated system state 
vector and its associated error covariance matrix are 
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The system process covariance matrix is 


Q = 


10 0 0 

0 10 0 

o o 0.1 o 

0 0 0 0.1 


And the measurement noise covariance matrix is 


30 2 0 

0 30 2 


The results of the tuned Kalman filter for the above scenario are portrayed in figure 3 
where the estimated flight path (each estimate is represented by an "o") is compared to the 
true flight path (represented by a straight line). Note that there is some lag in the Kalman 
filter estimates when the aircraft starts to turn. The square root of the MSE is 134 feet. This 
result shows that the Kalman filter can be properly tuned to handle dynamics when conditions 
of poor geometry arise. 

Normally, the Q matrix in the Kalman filter is set artificially high such that the filter can 
follow a vehicle through periods when dynamics exist. In order to see how ridge regression 
can reduce the square root of the MSE, implement the same simulation set-up provided above 
with a much higher Q matrix. 


Q = 


500 0 0 0 

0 500 0 0 

0 0 500 0 

0 0 0 500 


The estimated and true aircraft flight paths are shown in figure 4. 
MSE becomes 304 feet. 


The square root of the 
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Now, add a proper ridge parameter matrix, P R , to counteract the effects of poor geometry. 
In effect, adding P R is similar to making Q smaller. Figure 5 depicts the resulting estimated 
and true aircraft flight paths. The square root of the MSE reduces to 142 feet. This shows 
that a properly selected P R matrix can give results that are comparable to the tuned Kalman 
filter described above. Efforts are continuing to address the performance of the extended 
Ridge/EKF in detail. 


CONCLUSIONS 

Ridge regression signal processing is introduced to explain the behavior of a mismatched 
Kalman filter. This paper provides an initial comparison of the extended Kalman filter (EKF) 
and the recursive ridge filter (the Ridge/EKF). It is shown that a proper ridge parameter 
matrix P R , may be chosen to counteract poor geometry conditions that may arise when 
estimating a position. 
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ORDINARY LEAST SQUARES (OLS) 


RIDGE REGRESSION 



TRUTH ( p ) 



MSE - BIAS 2 + VARIANCE 


Figure 1. Comparison of unbiased and biased solution distributions and definition of the Mean 
Squared Error (MSE). 


Enter the a priori estimate 1 0 
and its error covariance P 0 



Figure 2. Kalman filter equations for a linear system. 
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Extended Kalman Filter: Properly Tuned 
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Figure 3. Simulation results for a properly tuned extended Kalman filter (small system 
covariance). 
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Figure 4. 


Simulation results for an extended Kalman filter allowing for dynamics (large system 
covariance). 
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Figure 5. Simulation results for a Ridge/EKF filter. 
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